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We present recent advances in the instrumentation and analysis methods for quantitative imaging 
of concentrated colloidal suspensions under flow. After a brief review of colloidal imaging, we de- 
scribe various flow geometries for two and and three-dimensional (3D) imaging, including a 'confocal 
rheoscope'. This latter combination of a confocal microscope and a rheometer permits simultaneous 
characterization of rheological response and 3D microstructural imaging. The main part of the paper 
discusses in detail how to identify and track particles from confocal images taken during flow. After 
analyzing the performance of the most commonly used colloid tracking algorithm by Crocker and 
Grier extended to flowing systems, we propose two new algorithms for reliable particle tracking in 
non-uniform flows to the level of accuracy already available for quiescent systems. We illustrate the 
methods by applying it to data collected from colloidal flows in three different geometries (channel 
flow, parallel plate shear and cone-plate rheometry). 

PACS numbers: 83.80.Hj, 83.50.Ha, 83.60.La, 64.70.Pf, 61.20.Ne, 61.43.Pb, 82.70.Dd 
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I. INTRODUCTION 

The last two decades have seen a surge of interest in 
the behavior of concentrated colloidal suspensions. These 
systems have long attracted attention because of their 
evident practical importance. However, developments 
since the 1980s have shown that well-characterized col- 
loidal suspensions, in which the size, shape and interac- 
tion of the particles are known, can serve as experimental 
model systems for understanding generic phenomena in 
condensed systems. Initially, this 'colloids as big atoms' 
approach has focussed on the use of model colloids to 
study equilibrium phenomena in the bulk such as liquid 
structure and phase behavior [H, @, Since then, in- 
terfacial phenomena have been investigated [H, as well 
as bulk non-equilibrium phenomena such as phase tran- 
sition kinetics Q , glassy arrest [1, 0] and gelation Q . In 
all cases, the well-characterized nature of the experimen- 
tal systems has meant that very direct comparison with 
theory and simulations are possible; such synergism gives 
rise to rapid advances in understanding. 

Most recently, the spotlight has been on the use of 
model colloids to study driven non-equilibrium phenom- 
ena. In particular, coincident with intense developments 
in a variety of theoretical approaches [§, [l(| El, c °l~ 
loids are increasingly seen as model systems for study- 
ing the rheology of arrested matter. Here, perhaps more 
so than previously, fundamental interest and immediate 
industrial relevance directly coincide. Concentrated par- 
ticulate suspensions, sometimes known as 'pastes', have 
widespread applications [12|, most (if not all) of which 
will involve the suspensions being mechanically driven 
far away from equilibrium either as part of processing 
(e.g. in ceramics manufacture [TH) and/or during use. 
Here, as before, the study of well-characterized colloids 
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can yield fundamental insights, many of which are likely 
applicable to 'real' systems with little need of 'transla- 
tion'. Moreover, we may expect that driven colloidal 
suspensions can, in some respects, be similar to driven 
granular materials, themselves the focus of intense study 
for both fundamental and applied reasons [3]. Quan- 
titative similarities of this kind have indeed been found 
recently for the case of channel flow If more such 

analogies are found in the future, a unified description of 
colloids and grains may indeed be possible [lq . 

The elucidation of structure and dynamics have always 
been important goals in the study of colloids in general, 
and of model colloids in particular. Traditionally, struc- 
tural and dynamical information in this and other ar- 
eas of soft matter science is derived from scattering pjj ■ 
The outputs from such experiments are the static and 
dynamic structure factors. These average quantities are 
often directly calculable from theory, which partly ex- 
plains the appeal of scattering methods in the first place. 

But the upper range of the colloidal length scale is in 
the optical domain, and so is amenable to direct imaging 
in an optical microscope. Given the centrality of imaging 
in Perrin's pioneering (and Nobel Prize winning) work 
using colloids to prove the existence of atoms |l8|, it is 
at first sight surprising that optical imaging has played 
almost no further role in the study of colloids until the 
last two decades of the 20th century. But the imaging 
of all but the most dilute suspensions had to await two 
developments. 

First, model systems are needed in which the refrac- 
tive index of the particles can be closely, if not perfectly, 
matched to that of the surrounding solvent; otherwise 
concentrated suspensions of large particles that are in 
principle optically observable are turbid, and thus not 
amenable to optical imaging. A number of such sys- 
tems have been developed since the 1980s. (The de- 
velopment of such system also benefit the use of light 
scattering, which also requires index matching.) Sec- 
ondly, an imaging method needs to be found that can 
deal with at least a certain degree of translucency in sam- 
ples. Such a method, confocal microscopy, was invented 
(and patented) by Marvin Minsky in 1955. The develop- 
ment of the methodology in the first few decades since 
its invention was driven largely by the requirements of 
biologists. Since the mid-1990s, however, there has been 
a surge in interest in applying confocal microscopy to the 
study of model concentrated colloidal suspensions. Ini- 
tially, this interest was focussed on quiescent systems [l9| . 
In the last few years, however, it has been demonstrated 
that confocal microscopy can also be used with profit to 
study flowing colloids, and thus yield unique insights into 
the rheology of pastes. The purpose of this work is to set 
out in detail, for the first time, how this can be done. 

The rest of the paper is organized as follows. We first 
briefly review the use of imaging methods to study col- 
loids. We then describe in Section HTll new hardware that 
we have developed to image colloidal flows in various 
geometries. In Section IIVI we review the basics of fea- 



ture identification in (confocal) images and discuss var- 
ious limits to particle identification in 2D and 3D flow 
fields. The core of the work is Section [V] where we turn 
to particle tracking. In Section TV Al we evaluate for the 
first time, using data from simulations, the applicability 
of a classic (and widely applied) tracking algorithm [2(| 
in quiescent and sheared systems where the average mo- 
tion is zero. We then describe in detail, Sections . IV Bl and 
IV C[ our new methods to track particles in the presence 
of flow. Finally, in Section I VII we demonstrate the ap- 
plicability of these methods to imaging colloidal flows in 
various geometries, including 'home built' environments 
and a commercial rhcomctcr. 



II. IMAGING COLLOIDAL SUSPENSIONS 

The imaging of a single layer of colloids is unproblem- 
atic, and has been used to great effect to study fundamen- 
tal processes in 2D, as illustrated by the work of Maret 
and his coworkers (e.g. [U [H| ) . Here we concentrate 
on imaging in 3D. 

The use of conventional (non-confocal) optical mi- 
croscopy to study concentrated colloidal suspensions in 
3D has been reviewed before [24]. In nearly index- 
matched suspensions, contrast is generated using either 
phase contrast or differential interference contrast (DIC) 
techniques. One advantage of conventional microscopy is 
speed: image frames can easily be acquired at video rate. 
But it has poor 'optical sectioning' due to the presence of 
significant out-of-focus information, so that particle coor- 
dinates in concentrated systems cannot be reconstructed 
in general, although structural information is still obtain- 
able under special circumstances [25| . 

Compared to conventional microscopy, confocal mi- 
croscopy delivers superior 'optical sectioning' by using 
a pinhole in a plane conjugate with the focal (xy) plane. 
It allows a crisp 3D image to be built up from a stack of 
2D images. But each 2D image needs to be acquired by 
scanning, which imposes limits on its speed. The tech- 
nique has been described in detail before f2l|. 

The use of confocal microscopy in the study of con- 
centrated colloidal suspensions was pioneered by van 
Blaaderen and Wiltzius [I?) , who show that the structure 
of a random close packed sediment could be reconstructed 
at the single particle level. The confocal microscopy of 
colloidal suspensions in the absence of flow has been re- 
viewed recently [l!j [H, H^, [3(| , and we refer the reader to 
these reviews for details and references. Here, we simply 
note that this methodology gives direct access to local 
processes, such as crystal nucleation |3l| and dynamic 
heterogeneities in hard-sphere suspensions near the glass 
transition [32|, [33j . 

In this work, we focus on the use of confocal mi- 
croscopy for imaging colloids under flow, or confocal 
'rheo- imaging' (reviewed in 34]). Conventional rheology 
studies the mechanical response of bulk samples. As far 
as the study of concentrated, model suspensions is con- 
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cerned, much attention has been given in the last few 
years to non-linear rheological phenomena, e.g., the dif- 
ferent ways in which repulsion- and attraction-dominated 
colloidal glasses yield [ID, [36[ . The bulk rheological data 
are consistent with the former yielding by a single-step 
process of 'cage breaking', and the latter yielding in two 
steps, first breaking interparticle bonds, and then break- 
ing nearest-neighbor cages. Confocal imaging can play 
a decisive role in the verification of such microscopic in- 
terpretation, which inevitably makes reference to local 
processes on the single-particle level. 

Moreover, direct imaging can clearly shed light on 
complicating factors in conventional rheological measure- 
ments such as wall slip f37l . l38j and flow non- uniformities 
such as shear banding [3!|. Here, significant progress can 
be made without imaging at single-particle resolution, by 
using various coarse-grained velocimetry methods. Tra- 
ditional Particle Image Velocimetry (PIV) [13] requires 
transparent samples. This technique has recently been 
used in a rheometer to give important information on 
slip in emulsions [JJ, [42j ■ Other methods for velocimetry 
have been developed that has no requirement for trans- 
parency, such as heterodyne light-scattering [H[ and ul- 
trasonic velocimetry [44j . The latter has been applied to 
characterize slip and flow nonlinearities in micelles and 
emulsions [H, |46j. 

A robust method for velocimetry which can also pro- 
vide additional information on the density profile is Nu- 
clear Magnetic Resonance Imaging (NMRI) [47 l l48 l l49l. 
[50j . The technique has spatial resolution down to ~ 
20 fim and has been combined with rheometric setups to 
relate velocity profiles to macroscopic rheology [5l|, [H^] • 
This approach has been used to investigate the occur- 
rence of shear bands (53| and shear thickening [54[ . 

Thus, both PIV and NMRI give additional insight un- 
available from bulk rheology alone. But to build up a 
complete picture of colloidal flow, it is desirable also to 
have information on the single particle level. For this pur- 
pose, a method related to PIV and particle tracking has 
been applied to non-Brownian suspensions and allowed 
the measurement of non-affine particle motion and diffu- 
sivity [55L I5H ] . But direct imaging of the microstructure 
during flow is needed to give complete microstructural 
information. Optical microscopy has this capability. 

It is possible to use conventional (non-confocal) video 
microscopy to study shear effects in 3D [57l [H, [59|, [6(| • 
But the poor optical sectioning hinders complete, quanti- 
tative image analysis. Confocal microscopy significantly 
improves sectioning, and permits in principle the extrac- 
tion of particle coordinates. But the need for scanning 
initially meant rather slow data acquisition rates, so that 
observations in real time (i.e. during shear) produced 
blurred images that again limited the potential for quan- 
titative analysis (6lT |. A common solution was to apply 
shear, and then i mag e immediately after the cessation of 
shear, both in 2D [glUl and in 3D [HI, H [H [llfEar- 
lier work using conventional video microscopy [571 1581 ] 
resorted to the same strategy.) 



More recently, the availability of fast confocal systems 
(see Section IIII Bl) means that nearly-real-time recon- 
struction of structure during flow in 3D at single-particle 
resolution has become possible. Such experiments face 
two key challenges: sample environment and data anal- 
ysis. First, the flow geometry used clearly must be com- 
patible with the optical requirements of simultaneous 
confocal imaging. A number of different arrangements 
have been demonstrated to date. Derks and co-workers 
carried out a first experimental study by using a counter- 
rotating cone and plate shear cell combined with a fast 
confocal microscope [(57j and obtained particle coordi- 
nates and tracks in the zero-velocity plane as well as ve- 
locity profiles across the geometry gap. The same group 
has recently produced a more sophisticated set up which 
uses a parallel plate shear cell [681 ] capable of spanning 
a vast range of shear rates and frequencies which they 
used to study crystallization of colloids under shear. A 
parallel plate shear cell has also been used by Besseling 
and co-workers (69[ to study the shear-induced relaxation 
in hard-sphere colloidal glasses, while recent experiments 
by Isa and co-workers [l5j have elucidated the behaviour 
of colloidal sediments flowing into micro-channels. In 
this work, we give the details for two of these geome- 
tries [H, [69j], and describe and demonstrate a new one: 
the coupling of a fast confocal scanner to a commercial 
rheometer, which allows simultaneous confocal imaging 
and full rheological characterization of the same sample. 

The second challenge is data analysis: how to extract 
accurate particle coordinates from raw image stacks. In 
particular, special methods are needed for reliable track- 
ing, since the large displacements from frame to frame 
imposed by flow may inhibit correct identification of par- 
ticles between frames. The same problem confronts the 
use of imaging to study granular flows [70j . In this work, 
we describe in detail a new method for tracking particles 
from confocal images acquired during flow. We demon- 
strate its correctness and measure its limitations by using 
data from computer simulations, as well as illustrate its 
use with real experimental data. 



III. MATERIALS AND INSTRUMENTATION 
A. The colloidal particles 

Our goal is to perform confocal imaging in real time at 
single-particle resolution of colloidal suspensions under 
flow. Confocal microscopy is, in principle, able to imag- 
ing 'inside' slightly turbid systems, but the image quality 
deteriorates with sample turbidity. In order to obtain as 
sharp images as possible to test the limits of our method- 
ology, we performed experiments using a index-matched 
suspension that is optically clear. 

The particles were poly-methyl-methacrylatc 
(PMMA) spheres, sterically-stabilized by chemically- 
grafting poly-12-hydroxy stearic acid (PHSA) [7l| . 
The particles can be dyed with a fluorophore (NBD, 4 
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chloro-7 nitrobenz-2 oxa 1,3 diazole), which is excited at 
488 nm and emits at 525 nm. Particles can be suspended 
in a mixture of decalin (mixed-decahydronaphtalene, 
Sigma- Aldrich, n doca i in = 1.4725 ± 0.0005) and 
tctralin (tetrahydronaphtalene, Sigma-Aldrich, 
^tetraiin — 1.5410±0.0005) to achieve full refractive index 
matching of the solvent and the particles (n S usp ~ 1 .5) . 
This matching assures hard-spheres interactions [72j 
and also limits scattering of both the laser and the 
excited light during confocal microscopy. However, the 
decalin-tetralin mixture has a lower density than PMMA 
(1.188g/cm 3 ). To achieve buoyancy-matching, particles 
can be suspended in a mixture of cyclo-heptyl-bromidc 
(CHB) and mixed-decalin The buoyancy-matching 
composition also closely matches the refractive index 
of the suspension (n susp = 1.494) (28|. The addition of 
CHB to a hard-spheres suspension induces charge on the 
particles, which can be screened by adding a suitable 
amount of salt [73| (tetrabutylammonium chloride, 
(C 4 H 9 ) 4 NC1, M w = 277.92g/mol, Fluka). 

The buoyancy-matching is very sensitive to temper- 
ature changes; the thermal expansion coefficient of the 
solvent exceeds that of PMMA by about a factor ten 
and a decalin-CHB mixture of a given composition will 
therefore match the particle density only in a very nar- 
row temperature range (74j . We exploit this fact to pre- 
pare suspensions of different volume fractions by cen- 
trifuging the suspension at a temperature higher than 
the buoyancy-matching one. Finally, imaging can either 
be performed on a fully fluorescent sample or on refrac- 
tive index matched systems seeded with fluorescent par- 
ticles. In the course of our description we shall specify 
the details of the system used in each example. 




FIG. 1: Projection of a raw 3D image stack of a concen- 
trated colloidal suspension, acquired in ~ 1 s. The thickness 
is 10 /im. 



magnification, oil-immersion objective with a numerical 
aperture (NA) of 1.4. The depth of the focal plane, z, 
is controlled by a piezo-elemcnt mounted on the micro- 
scope nosepiece. For 3D imaging, a z-stack of 2D im- 
ages is collected (Fig. rjj by rapid variation of the height 
of the piezo and synchronized 2D acquisition at each z. 
The corresponding 3D acquisition time is iV z // scan with 
N z the number of 2D slices. We have also coupled the 
confocal scanner to a commercial rheometer, to enable 
simultaneous imaging and rheological measurements on 
the same sample. 



C. Shear cell 



B. The confocal microscope 

To perform confocal imaging during flow, high acqui- 
sition rates and thus fast laser scanning methods are 
required. Among these are spinning disk systems (26| 
(with possible micro-lens array extension) or laser scan- 
ning by resonant galvanometric mirrors. The confocal 
scanner we use (VT-Eye, Visitech International, with 
a solid state 488 nm laser) employs a combination of 
a standard galvanometer and an acousto-optic deflector 
(AOD) [95|]. The former positions the laser beam at a cer- 
tain y-position, while the AOD much more rapidly scans 
a line along x. The acquisition rate is thus mainly deter- 
mined by the 'slow' galvanometer. Typical frame rates 
for 2D image series range from / scan = 5 Hz for images 
of 1024 x 1024 pixels to / scan = 100 - 200 Hz for images 
of 256 x 256 pixels. The upper limits on colloid diffusiv- 
ity or flow speed imposed by these acquisition rates are 
described in Sec. HVBl 

We have imaged flow in a parallel-plate shear cell and 
in square capillaries using the 'standard configuration', 
where the confocal scanner is coupled to a Nikon TE 
Eclipse 300 inverted microscope, with a 100 x or 60 x 



Initial experiments on shear flow were performed with 
a linear parallel-plate shear cell (plate separation Z gap ~ 
400 — 800 /j,m, parallel to ±5 fim over a lateral distance of 
2 cm) where the top plate is driven at 0.05 — 10 /j,m/s by a 
mechanical actuator with magnetic encoder. We denote 
the velocity, vorticity and velocity gradient direction by 
x, y, and z, respectively, as shown in Fig. O The max- 
imum relative plate translation along x is L s ~ l cm, 
so that steady shear can be applied up to a total ac- 
cumulated strain A7 = L s /Z gap > 1000%. The cell 
can be operated either with the bottom plate fixed or 
with the plates counter propagating via an adjustable 
lever system, which allows the height of the zero velocity 
plane to be set at any distance from the bottom plate. 
A drop of suspension (covering an area of ~ 200 mm 2 ) 
is confined between the plates by surface tension. A sol- 
vent bath surrounding the plates minimizes evaporation. 
Wall slip, prominent in glassy systems [75[, and wall- 
induced ordering were prevented by sintering a concen- 
trated, disordered layer of particles - obtained by spin- 
coating a <j) ~ 30% suspension - onto the glass surfaces, 
Figure [3Ka). We typically image a 30 /im x 30 /im x 15 
fim volume in the drop (with ~ 3000 particles), up to 
~ 40 fim above the coverslide. 
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FIG. 4: Sketch of the sample cell for capillary flow. The 
capillary is not drawn to scale. The construction is placed on 
the microscope stage plate and the flow is imaged from below. 



FIG. 2: Sketch of the shear cell. The sample is positioned 
between two parallel slides; the top one is driven by a me- 
chanical actuator while the bottom one can either be fixed or 
be translated in the opposite direction (dashed arrow). The 
suspension is imaged from below (image volume highlighted) 
with a confocal microscope whose focal depth is controlled by 
a piezo-electric motor. 



Capillary 




FIG. 3: Confocal images of the coating (a) on a cover slide 
for shear flow imaging (image size 56 x 56 /im 2 ), (b) on the 
inner surface of a 50 x 50 fim 2 glass capillary (image size 
43 x 43 /im 2 ). The larger particles in (b) form the coating, 
the smaller ones are suspended and flowing. 



D. Capillary flow 

We have also studied the flow of concentrated colloidal 
suspensions in glass micro-channels [H, [ZSj ■ Figure [4] 
shows a sketch of a sample cell for such experiments. It 
is assembled by gluing a glass capillary onto a micro- 
scope coverslide with UV curing glue (Norland Optical 
Adhesive) by exposing it to UV light for a few minutes. 
Once the glass channel is attached, a glass vial (1.5 cm 
diameter) , the bottom of which is removed, is glued on 
top of one end of the channel also with UV glue (2 hours 
exposure). Finally a PVC tube (1 mm internal diame- 
ter) is connected to the free end of the capillary and the 
connection is sealed with epoxy glue. The sample cell is 
positioned onto the microscope stage with the cover slide, 
forming the bottom of the cell, in direct contact with the 
microscope objective via the immersion oil. 

All channels are borosilicate glass capillaries (Vit- 
rocom) with rectangular (20 x 200^m 2 , 30 x 300/im 2 , 
40 x 400/im 2 ) or square cross sections (50 x 50/im 2 , 




Image plane 



Microscope 
objective 



FIG. 5: Close up of the experimental geometry. For clarity 
only the capillary and objective are drawn. The flow (green 
arrow) is imaged from below and 2D xy slices are collected at 
a depth z. 



80 x 80^m, 100 x 100^m) and a length of 10 cm. The 
capillaries can either be used untreated, i.e. smooth on 
the particle scale, or have their inner walls coated with 
a sintered disordered layer of PMMA particles to ensure 
rough boundaries (Figure [3] b). This is achieved by filling 
the capillary with a 15-20% suspension of similar parti- 
cles and subsequent drying in a vacuum oven at 110-120 
°C. 

The imaging geometry is sketched in Fig. The flow 
is along the channel in the x direction; by adjusting the 
image size we can capture the entire cross section of the 
capillary. Using a modified microscope stage plate with 
a long rectangular slot instead of the standard circular 
aperture, the imaging can be performed at different po- 
sitions along the channel, over a range of < 5 cm. The 
suspension is first loaded into the sample cell and then 
driven along the channel by a constant pressure difference 
achieved by motorized displacement of a syringe plunger 
connected to the PVC tubing. During imaging, the pres- 
sure is monitored with a pressure gauge (MKS Series 902 
Piezo Transducer). 



6 



to confocal 




objective 



mirror and 
piezo-element 



FIG. 6: Schematics of the confocal rheoscope. The top arrow 
marks translation of the rheometer head to adjust the geome- 
try gap, the horizontal arrow indicates translation of the arm 
supporting the objective to image at different radial positions. 



E. Confocal rheoscope 




FIG. 7: (a) Zoom in on the central part of the confocal rheo- 
scope. The position of the mirror, directly underneath the 
piezo, is indicated as B in the right figure, (b) Global sketch of 
our implementation. The optical path (colored) from the con- 
focal (CF) is guided from the back of the microscope (Nikon) 
via mirrors and two lenses LI and L2, to position B corre- 
sponding to the mirror in (a). The distance between lenses LI 
and L2 is 2f+d, with / the focal length. The distance between 
the standard position of the objective back aperture (above 
A) and the new one (above B) is 4/ + d, where | d |< 1 cm 
allows for lateral positioning underneath the plate. 



In order to perform confocal imaging of the flow and 
simultaneously obtain the global suspension rheology, we 
have combined the fast confocal scanner with a stress 
controlled rheometer (AR2000, TA Instruments), Figs. [6] 
and [7J The rheometer has a custom-built, open base con- 
struction, mounted on its normal force sensor, with pil- 
lars providing space for a mirror and objective mounted 
on a piezo-element, which makes it possible to vary the 
depth of the focal plane. An aluminium plate with imag- 
ing slit is mounted on the pillars, and can be accurately 
leveled via three adjustment screws. A glass slide (ra- 
dius 2.5 cm, thickness ~ 180 fim), mounted on the plate, 
forms the bottom surface of the measurement geometry 
through which the imaging is performed. The rheometer 
can thus be operated in plate-plate or cone-plate geome- 
try, but generally we used a stainless steel cone of radius 
r c = 20 mm and cone angle — 1°. Both the glass slide 
and the cone can be made rough on the particle scale us- 
ing the spincoating and sintering method. Evaporation 
can be minimized by a solvent trap, but we found supe- 
rior reproducibility of the rheology of the most concen- 
trated suspensions by slightly under-loading the geom- 
etry and applying a tiny rim of immiscible liquid (glyc- 
erol) around the geometry edge. Finally, we checked that 
bending of the cover slide was negligible, see Sec. IVI CI 

The confocal scanner is coupled to the optics under 
the plate. In our setup, the scanner remains fixed in the 
standard configuration, connected via a C-mount to the 
Nikon microscope, see Fig.[JJb). To provide the coupling, 
we altered the optical path of the laser and the excited 
light. By positioning a movable mirror, the beam exits 
through the rear of the microscope (Fig. [7Jb)) and then 
passes through additional mirrors and two lenses; one of 
the lenses is mounted on a mechanical 'arm', at the end of 
which, situated below the transparent plate, a final mir- 
ror and the piezo objective mount are located. The two 



lenses provide one-to-one imaging of the back-aperture of 
the objective in its standard position on the nosepiece of 
the Nikon, onto that of the objective in its new position 
under the transparent rheometer plate. During imag- 
ing, the piezo-element is controlled by the software of 
the confocal microscope, providing the same 3D imaging 
capability as in normal operation. 



IV. PARTICLE LOCATION AND ITS 
LIMITATIONS 

A. Locating and identifying the particles 

The first step to obtain quantitative information on 
particle dynamics from the images is to locate the par- 
ticles. The most widely used algorithm for this purpose 
to date in colloid science is that of Crocker and Grier 
[CG) [2(J, with relevant software in the public domain 

Three main assumptions are needed in order to locate 
and identify the particles. The features must appear as 
bright objects onto a dark background, we assume that 
they are spherical in shape [96| , and that the maximum 
in the brightness of a feature corresponds to its center. 
The concepts at the basis of feature location are still 
applicable to objects which do not follow these require- 
ments but the practical algorithm for locating them will 
be different and generally more complicated, see e.g. [7c| . 

Since the particle centers are identified in terms of their 
intensity, undesired intensity modulations which can give 
rise to mistakes in particle location need to be eliminated. 
This is achieved via image filtering using a spatial band- 
pass filter. This eliminates any long wavelength contrast 
gradients and also short wavelength pixel to pixel noise. 

The coordinates of the centers of the features are ini- 
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tially obtained by locating the local intensity maxima 
in the filtered images. A pixel corresponds to a parti- 
cle center if no other pixel has a higher intensity within 
a given distance to it; typically this distance is slightly 
larger than the average particle radius. These coordi- 
nates are then refined to get the positions of the particle 
centers with a higher accuracy by applying a centroiding 
algorithm which locates the brightness-weighted center 
of mass (centroid) of the particles. With this refinement 
procedure the coordinates of the particle centers can be 
obtained with sub pixel resolution down to less than 1/10 
of the pixel size [201 ] . The centroiding procedure proves 
itself effective but has some limitations. Correctly locat- 
ing the particles becomes more difficult as the system be- 
comes more concentrated and individual particle images 
may start to overlap. This difficulty can be dealt with 
by fluorescent labeling only the particle cores [HJ so that 
images are well separated even at the highest densities. 
When such particles are not available, improvements in 
coordinate refinement may be required. Such an improve- 
ment, based on fitting the intensity profile of the particle 
to the 'sphere spread function' (SSF), has been devised 
by Jenkins [73|. We have used this method success- 
fully for our 3D images described in Sec. IVI Bl Finally, 
to avoid edge effects, particle centers identified within a 
radius from the image edge are ignored. 

As noted above, the coordinates of particle centers are 
often found to an accuracy tied to the pixel size. This 
correctly implies that modifying the microscope optics 
so that the size of a pixel is smaller will improve the lo- 
cation of particle centers. In general, if the image of a 
particle is N pixels across, the center of that particle can 
be found to an accuracy of (pixel size) /N . It is important 
to recognize that this accuracy is different from, and of- 
ten better than, the optical resolution of the microscope. 
The optical resolution relates to telling the difference be- 
tween two closely positioned bright objects: if they are 
closer together than the resolution, then their diffraction- 
limited images blur together in the image. The resolution 
limit for an optical microscope is given by the wavelength 
of light used and the numerical aperture (NA) of the ob- 
jective lens, as A/(2NA), and the best resolution for an 
optical microscope is about 0.2 /im. This figure reflects 
the wave nature of light. The accuracy with which par- 
ticle centers can be located is set by different physical 
constraints, e.g. the fact that particles cannot physically 
overlap (although their images may) [2(| , and the knowl- 
edge that they are spherical. 



B. Limitations 

The above mentioned accuracy of locating particles is 
intrinsic, and applies even for particles 'frozen' in the im- 
age. It can be estimated from the plateau value of the 
mean squared frame to frame displacements (which we 
denote as MSFD) measured in a close packed sediment, 
where particles are essentially immobile. In general how- 



ever, additional errors on the exact center position arise 
from short time diffusive motion and flow advection dur- 
ing acquisition of the particle image, if the images are 
from a scanning system (such as a confocal microscope) 
which does not acquire each pixel simultaneously 

Let us estimate these effects for 2D and 3D imaging. 
For the 2D case, given the frame acquisition rate / sca n 
and the image size in pixels (n x m), the time required to 
scan one line is ~ l/(n/ scan ). If R is the particle radius 
in pixels, then the time required to image a particle is: 

tj£ = 2R/(nf scan ). (I) 

With our imaging system, a 256 x 256 pixel image can 
be taken at / scan = 90 Hz. Using a 100 x magnification 
objective, for which the xy pixel size is ~ 0.2 /zm, the 
time to acquire a 2D image of a particle with R — 1 /im 
is therefore tf£ ~ 0.4 ms. 

For 3D images, acquired stack of 2D slices, the 

limiting factor is the speed at which the particle is im- 
aged in the z-direction. The voxel size in the z direction 
(i.e. the z-spacing between the 2D slices) may differ from 
that in the x and y direction. Denoting the particle ra- 
dius in z-pixels by i? z , the time required for a 3D particle 
image is: 

^im = 2i? z / /scam (2) 

with / scall the acquisition rate for a complete 2D image as 
before. Thus, for the 3D case, using again / scan = 90 Hz 
and a typical value of 0.2 /im for the z-pixel size, the 
acquisition time for our R = 1 fim particle is tf® ~ 0.1 s. 

We first consider the (short time) diffusive motion of 
colloids in a suspension on these time scales. In the di- 
lute limit, the diffusion constant is D Sy o — (ksT) / (6nr]R) , 
with &b the Boltzmann constant and rj the solvent vis- 
cosity. For concentrated suspensions the short time diffu- 
sion constant is reduced due to hydrodynamic hinde ring , 

D s ((f>) = D afi H((t>) with H(<f>) < 1 Hfl M, m m nj. 

The average motion in one direction during the acqui- 
sition time is -\/2Z? s (</>)£;,„, i.e. the additional error is 
5 = y/Ds(4>)t im /2. Using r\ = 2.7 x 10~ 3 Pa-s for our sol- 
vent (decalin) and T = 300 K, D s , = 8.13 x 10" 2 /im 2 /s 
for the R = 1 /jm colloid. The resulting error due to 
thermal displacement during 2D imaging of a dilute sys- 
tem is then 8 2 d — 2 nm, while for the 3D case, using 
the same frame rate and z-pixel size as above, we have 
630 — 35 nm. While the former is considerably smaller 
than the intrinsic 1/10 pixel accuracy (~ 20 nm), for 
3D the thermal motion is the limiting factor. Note that 
these considerations apply to hard sphere systems only; 
when additional interactions limit the short time dis- 
placements, the intrinsic 1/10 pixel limit may still apply. 

Flow can also induce additional errors on the particle 
location due to image distortion. Since the image of a 
particle is scanned either via lines in 2D or via horizontal 
slices in 3D, it will be distorted because the particle is 
displaced between two consecutive lines as well as 'slices'. 
Such distortion can be exploited to deduce the local flow 
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velocity, see [13] , but here we are interested in the veloc- 
ity range for which the distortion is sufficiently small to 
consider the object as effectively spherical. The particle 
speed beyond which this no longer holds can be estimated 
by comparing the imaging time t- lm with the time tf re- 
quired for the flow to displace the particle over its own 
diameter. For a flow velocity V (in pixels per second), 
t{ = 2R/V. We consider the particle significantly dis- 
torted if tim/tf > 0.1, i.e. a distortion of 1 pixel for a 
particle size 2R = 10. Using Eqs. If 121 for the acquisition 
times, the maximum velocities are: 

V^ D ax = 0.fn/ scan , V 3 m D ax = 0.1fR/R z . (3) 

For typical parameters (/ SC an = 90 Hz, n — 256 pix- 
els, f pixel ~ 0.2 /im) the limiting velocity in 2D is 
ymax ^ 5QQ ^ m / Sj while for 3D images we obtain 
ymax ^ ^ ^m/s for an x to z pixel size ratio of f:i. 
In both cases, further improvement could be achieved by 
removing the distortion prior to locating the particles via 
image correlation procedures (67j or by quantitatively ac- 
counting for distortions and performing the centroiding 
algorithm using a 'distorted particle template'. 

V. TRACKING ALGORITHMS 

Once the coordinates have been found in each frame, 
they need to be merged into trajectories describing the 
particle motion. In this 'tracking' procedure, each parti- 
cle is labeled with an identification tag and an algorithm 
looks for particles in the following frame that can be as- 
signed the same tag. Tracking has applications in fields 
as diverse as robotics and biophysics [71, [H, Ull • In the 
field of digital image processing a variety of methods has 
been devised [87j • In each method, a specific cost func- 
tion is calculated based on the changes in coordinates for 
each set of identifications, possibly extended with a cost 
function for change in feature appearance 87]. The 'cor- 
rect' identification is then obtained as the one for which 
the cost function is minimized. 

A. The classic CG algorithm 

1. Tracking algorithm 

The algorithm we use, devised by Crocker and Grier 
(CG), is based on the dynamic properties of non- 
interacting colloids [20] . The cost function in this case is 
the mean squared frame to frame displacement (MSFD, 
as defined before) of particles between frames. Given 
the position of a particle in a frame and all the possible 
new positions, in the following frame, within a 'tracking 
range' Rt of the old position, the algorithm chooses the 
identification which results in the minimum MSFD. Par- 
ticles moving farther than Rt between frames are unable 
to be tracked, and are either mis-identified as other par- 
ticles, or else treated by the algorithm as new particles. 



Note that the original CG algorithm also includes the 
ideas discussed in Sec. HVj here we focus on tracking 
particles between successive frames, rather than locat- 
ing particles in a single image. These two parts of the 
CG algorithm are decoupled: the tracking method works 
independently of how the particles were originally iden- 
tified. 



2. Hard particle simulations 

Crocker and Grier tested their algorithm by tracking 
the self diffusion of particles in dilute colloidal suspen- 
sions [201 ] . Since then, the algorithm has been applied 
in various studies of quiescent colloidal systems (l9l 130] ] . 
However, quantitative studies of its tracking performance 
in realistic concentrated systems, possibly with addi- 
tional motion on top of Brownian diffusion, have not been 
performed to date. In fact, the study of concentrated sys- 
tems explicitly pushes the CG tracking algorithm beyond 
its design parameters. We therefore apply the classic CG 
algorithm to computer generated data, in which the par- 
ticle identity is known a priori, and evaluate its perfor- 
mance for quiescent systems of different densities and for 
various imposed particle motions. Quiescent data were 
generated by Monte-Carlo (MC) simulation of hard-disks 
in two dimensions and of hard-spheres in 3D (see e.g. [881 ]) 
imposing mean squared displacements between each MC 
iteration chosen to obtain a sufficient success rate. We 
simulated N > 1200 particles and, as in experimental 
data, particles may (dis)appear at arbitrary times around 
the edge of our simulation cell. At sufficiently high con- 
centration, the dependence of the mean squared displace- 
ment on the lag time, (dr 2 (r)} (the 'MSD'), shows a tran- 
sition from short ('in-cage') to long-time ('cage breaking') 
diffusion, as expected for dense fluids [88| [93]. 

We take the data from the simulations, and treat it 
as the raw data of particle positions for the classic CG- 
algorithm. Specifically, we use the CG-algorithm to track 
particles between MC-iterations i and i + n, for which 

the true MSFD is (J2A r i+n ~ H) 2 ) = ( dr l)i with 3 = 
x, y, z. The key idea of the CG-algorithm is that ideally, 
between each frame of the movie, the majority of particles 
should move less than the typical interparticle (center-to- 
center) spacing A. In other words, it is desirable for the 
MSFD to be less than A 2 . In fact, since the MSFD is 
calculated by averaging over all particles, many particles 
will have larger motions; likewise A is an average over 
all particles, so that some particles are closer together. 
Thus, in practice, it is desirable that the MSFD is much 
less than A 2 . 

To quantify this last statement, we tracked simulated 
particles between frames with progressively larger nor- 
malized MSFD, e 2 = (c?r 2 )/A 2 , by increasing n, and 
tested how the CG-algorithm performed when pushed 
past its original design parameters. For each e 2 , we mea- 
sured the fraction / of correctly tracked particles. We 
checked in all cases that the vast majority of the track- 
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ing errors are generated in the bulk of the system rather 
than at the boundaries. 198] 



3. Quiescent system 

In Fig. [HUa) we show / as function of e 2 for the 2D sys- 
tem at different <p2D and 4>%d- As expected, / decreases 
with increasing e„, but the performance in more concen- 
trated systems is considerably better than in the dilute 
case. To quantify this finding, we impose a criterion for 
'successful tracking' of / > 0.99, and we find that the al- 
gorithm works up to e„ = 0.15 at the lowest <p2D studied, 
but this figure rises and essentially saturates at e„ = 0.3 
at the highest 4>2D- This behavior reflects the difference 
in structure between a dilute and concentrated system. 
While A is the average nearest neighbor spacing, in a 
dilute system, particles can approach much closer than 
this (although still limited to be at least 2R apart). In 
this case, two closely spaced particles could potentially 
swap positions and confuse the tracking algorithm. In 
contrast, for a concentrated system, A w 2R, and it is 
much harder for particles to swap positions. Thus in a 
concentrated system there are fewer misidcntifications for 
a given value of e compared to a dilute system with the 
same e. For the 3D systems, the performance at large 
concentration is even better, i.e. for 03_d — 0.2, the algo- 
rithm works up to e„ ~ 0.4 and is expected to saturate 
at e n ~ 0.5 for the largest cj)zD- 

An experimental diagnostic for correct tracking is 
the distribution of particle displacements from frame to 
frame, P(dx) (99|. For correct tracking it should vanish 
smoothly within the tracking range. Figure [8](b) com- 
pares the true distribution function over n frames, Pmc-, 
with that resulting from the classic CG tracking between 
frames i and i + n, Pcd for two densities and n such 
that / ~ 0.98. In both cases Pcg follows the simulation 
data for dx < Rt, beyond which is cut-off, and the dis- 
crepancies with PmCi due to the misidentified particles 
(1 — / = 2%), appear in the large dx/A tails (clearer in 
the denser case). Note that the CG algorithm is able to 
follow particles for larger tracking ranges in the case of 
larger area (or volume) fractions. 



4- 2D system in shear flow 

To test the performance of classic CG tracking in the 
presence of non-uniform motion, we superimpose affinc 
shear and random displacements with a MSFD of (eA) 2 
on a single 2D MC configuration with cj>2D — 0.33. The 
strain increment between frames is Sj, i.e. the affine x- 
displacement over one frame for particle k is Sj(yk — y) 
(subtracting y guarantees zero net motion), again with 
periodic boundary conditions. We analyze data only 
over accumulated strains < 20%, so that shear does not 
bring neighboring particles in close proximity, avoiding 
'artificial' reduction in performance (see Sec. IV C 21 and 
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FIG. 8: (a) The fraction of correctly-tracked particles, /, ver- 
sus the normalized true MSD e 2 , between tracked frames for 
MC simulations of hard-disk fluids at various densities <f>2D 
and 3D hard-sphere fluids at </>ao = 0.03 and (f>3D = 0.2. Note 
the different a;-axis for the 2D and the 3D case, (b) Corre- 
sponding displacement distribution functions for two densities 
(j> 2D , taken for / ~ 0.98. Solid lines: the true PDF over n MC 
steps. Symbols: Pcg as obtained from classic CG tracking 
between frame i and i + n, for cj> = 0.01 (■) and cj> — 0.33 (▼). 
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FIG. 9: Evaluation of classic CG tracking under shear: (a) 
/ versus the normalized maximum difference in advected dis- 
placement between frames AS X /A = L y 5~//A for 4>2D = 0.33 
and e 2 = 0.005. (b) The distribution of particle displacements 
for AS X /A = 0.25 (squares) and AS X /A = 0.54 (circles). 
Solid line: result without shear. 



Fig. ll5[) . The true origin for tracking errors is the increase 
in the difference in advected displacements between dif- 
ferent parts of the 'image', the maximum of which is 
AS X /A = L y S^f/2A in units of the average spacing, with 
L y the system size in the velocity gradient direction. Fig- 
ure[9ja) shows that / rapidly decreases for AS X /A > 0.4. 

From the resulting tracks, we obtain the distribution of 
non-affinc frame to frame displacements after subtracting 
the affine shear as evaluated from the classic CG trajec- 
tories. The results for x and y displacements arc shown 
in Fig. Mb). For AS X /A = 0.25 the result is identi- 
cal to that without shear, matching the superimposed 
random motion. For AS X /A = 0.54, the distribution 
of y-displacements appears very close to the correct dis- 
tribution, but the deformed central peak of P x and the 
presence of prominent 'side bands' show that tracks have 
been evaluated incorrectly. 

Thus, the classic CG algorithm can track particles 
between consecutive frames for a maximum MSFD < 
(0.3A) 2 in quiescent concentrated hard-sphere-like sys- 
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terns, but considerably less in dilute systems. These lim- 
its are similar to those discussed in the original article by 
CG [13]. Simply put, for larger displacements, the prob- 
lem of uniquely identifying particles becomes ill-posed, 
as the possibilities of particles exchanging places become 
too significant. No algorithm can succeed in this case, 
and the only remedy is to acquire images at a faster rate 
to resolve the intermediate steps. 

Further, for non-uniform flow the limit is set by a max- 
imum difference in advected motion of ~ 0.4A over the 
full image. We also found that cut-off and distortion 
effects in the distribution of particle displacements can 
indeed be used as diagnostic of incorrect tracking, al- 
though one should be cautious to interpret the absence 
of such features as proof of 100% performance. The next 
subsection discusses a simple modification of the classic 
CG algorithm to deal better with particles in uniform or 
non-uniform flow. 
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FIG. 10: Iterated tracking results, (a) / versus the normalized 
shift s„/A between frames for tj> — 0.01, e\ = 0.01 and 4> = 
0.33, e„ — 0.06. (b) PDF's in the co-moving frame for 4>2d = 
0.33 and two 'drift' velocities: Line: the true PDF over n 
MC frames. (■): Pec for s„/A = 0.2, (•): distribution 
function of a-displacements -PcGj i n the co- moving frame for 
s n /A — 0.7, (o) same for ^-displacements. 



B. Iterated CG tracking algorithm 

1. Description 

The classic CG algorithm was designed for cases where 
all particles move randomly (due to Brownian motion). 
However, many interesting cases have particles moving 
in a flow with larger coherent structures, perhaps also 
with Brownian motion superimposed, or even simply 
noise. For example, the coherent motion could be due 
to Poiseuille flow through a pipe, overall drift of the field 
of view, or an induced shear flow. If the magnitude of 
this motion is small, the classic CG algorithm still has 
some ability to track particles. Following the logic above, 
tracking should work reasonably well if the distance most 
particles move between frames is moderately less than 
the interparticle spacing A, whatever the origin of this 
motion may be. 

In cases where the motion is simple and small com- 
pared to A, the classic CG algorithm can be iterated to 
produce better results. This "Iterated Tracking" method 
is as follows, (i) First identify the particle positions at 
each time, as per Sec. [TV] (ii) Track the particles us- 
ing the classic CG algorithm, (iii) Determine the coher- 
ent motion from the successfully tracked particles, (iv) 
Remove the coherent motion from the original particle 
positions, (v) Repeat steps ii-iv until most particles are 
successfully tracked, and the residual coherent motion 
detected in step iii is reduced to an acceptable level, (vi) 
Add back in all of the coherent motion that has been 
previously subtracted in all iterations of step iv. 

As long as the motion of most particles is less than 
the tracking limit Rj> and thus less than the interparticle 
spacing A, at least a few particles will be successfully 
tracked in the first iteration. The coherent motion of 
these few particles is then used to 'bootstrap' the classic 
CG algorithm, and in the subsequent iterations, more 
particles are correctly tracked. These then refine the 



coherent motion and thus the iterated tracking method 
eventually is able to converge on the correct trajectories 
for all the particles. In practice, this usually only takes 
3-4 iterations to produce good results. The key to iter- 
ated tracking is that the first tracking step must correctly 
track enough particles to start the process. We use our 
simulated data to study the breakdown of iterated track- 
ing in a test case. 



2. Uniformly moving system 

We first superimpose a uniform x-displacement s n over 
n MC steps on top of the MC dynamics. Periodic bound- 
ary conditions keep particles within the analysis window. 
We then perform iterated tracking on these particle po- 
sitions. Figure HOf a) shows / versus s„ for two densi- 
ties (f(s n = 0) > 0.995 in both cases). For small s n , 
f ~ f(s n = 0) ~ 1, but for s n /A > 0.5 very few correct 
tracks are found. Note that iterated tracking still pro- 
vides a result, but mostly consisting of incorrect tracks, 
and yields incorrect motion; in this case, the first tracking 
step has failed and subsequent tracking steps are unable 
to improve the results. In Fig. [TOTb) we show the distri- 
bution of particle displacements in the co-moving frame 
for two values of s n /A. By construction, the true Pmc l& 
identical to that in the quiescent system, while Pit is the 
displacement distribution in the co-moving frame, i.e. the 
frame where the average displacement of the 'IT-tracks' 
(obtained via the iterated tracking algorithm) vanishes. 
The breakdown of iterated tracking for s n /A = 0.7 in 
the 4> = 0.33 system is brought out by the sharp cut-off 
of P(dx > Rt), and, more prominently, by the asym- 
metry in the distribution of displacements Pf T along the 
direction of motion. 

The results are similar for non-uniform flow. If the 
maximum motion in any area of the data exceeds ~ 0.4A, 
that region will be poorly tracked. For example, with the 
shearing data discussed in Sec. IV A 41 at each iteration 
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step the measured shear strain can be removed, but this 
method will still have difficulties when AS X > 0.4. With 
care, trajectories found in regions with motion less than 
0.4A may be used to extrapolate the motion to the more 
mobile regions. Note that the classic CG algorithm was 
not intended for tracking particles in flow, so that the 
success of iterated tracking in non-trivial cases reveals 
the strength of that algorithm. 



C. Correlated image tracking 

1. Description 

Due to the limitations shown above, 2D or 3D images 
with large drift or non-uniform motion require a modi- 
fied analysis for correct tracking. Similar shortcomings of 
standard tracking for granular flows have been discussed 
in [7(| and analysis of such data will also benefit from 
the correction method we describe in this section. The 
basic ingredients of "Correlated Image Tracking" are: (i) 
We first obtain the particle coordinates as explained in 
Sec. IIV1 (ii) We then obtain independent information 
on the advected motion and its spatial and time depen- 
dence via PIV-type correlation analysis of the raw im- 
ages, (iii) Next, this (time and position dependent) ad- 
vected motion is subtracted from the bare particle coor- 
dinates. This yields the particle coordinates in a 'locally 
co-moving' ('CM') frame, (iv) In the CM frame, the 
particles can be tracked as in a quiescent system. The 
tracking efficiency is essentially limited by the value of 
the MSFD or non-affme motion in the CM frame, (v) 
After tracking, the advected motion is added back to the 
particle coordinates to obtain the trajectories in the lab- 
oratory frame. 

To identify frame to frame advective motion, we use 
standard PIV-type image correlation methods |40| . Con- 
sider a region of size n x m pixels of two consecutive 2D 
images i — 1 and i. Let Zj_i(x, y) and Ii(x,y) be the 
intensity patterns as function of position (x, y) of these 
(sections of) images. The covariance is defined as: 

cov[Ii--L(x,y), Ii(x,y)] 
1 



[(n x m) — 1] 
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where If 1 and If are the intensities of the pixel corre- 
sponding to position (x p , y q ) in each image and (Ii-\),(Ii) 
are the respective average intensities defined as (I) = 
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FIG. 11: Illustration of the shifting and correlation procedure. 
Each particle in the section of the image under consideration 
is displaced by (dx, dy) between frame 1 and frame 2. The 
entire image section is shifted over (A:r, Aj/) to maximize the 
correlation between the two successive sections. 



The correlation coefficient c[Ii-\(x, y), h(x, y)] of the two 
images is defined as: 



c[Ii-i(x,y),Ii(x,y)] = 



cov[Ii-i(x,y)Ii{x,y)] 
y /var[I i ^ 1 (x, y)]var[Ii (x, yj] 



i=0 j=o 



The motion is obtained by shifting image i by a certain 
number of pixels (Sx, Sy) and computing the correlation 
coefficient c[h-i(x, y), h(x — Sx, y — 5y)]. This is repeated 
for shifts within a desired range until c is maximized for 
Sx = Ax, Sy = Ay. Repeating the procedure over subse- 
quent frames yields the displacement as function of time 
(Ax, Ay)(ti) in the region of the image series under con- 
sideration, Fig.QT] For strongly time-dependent flows, a 
scan over all possible Sx, Sy in this region is required, but 
for smooth flows we have implemented a more efficient 
method in which image i is scanned in a narrow range 
centered around the shift (Ax, Ay)(ti^i) found from the 
previous images. A key point to recognize is that these 
shifts are quantized by the size of a pixel, so while the 
motion obtained from image correlation is a good starting 
point for the tracking, the subsequent tracking is neces- 
sary to achieve subpixel resolution of particle motion. 

In most applications one can identify, at least within 
the microscope field of view (see Sec. IIII El) , a principal 
axis along which the flow takes place. The entire image 
can then be rotated such that the advective motion oc- 
curs in only one direction, which we denote by x. To 
obtain the advection profile over the entire image, the 
correlation method is applied in different ways depending 
on the uniformity of the motion and image dimensional- 
ity, as we describe now. 

For 2D images, when the motion is spatially uniform in 
the xy plane, the above procedure is applied to the entire 
image, Fig. [T2T a). resulting in Ar(r, tj) = Ax(r, ti) = 
Ax{ti). The advective motion can also depend on the 
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FIG. 12: Examples of 2D image correlation procedures, (a) 
A uniform shift Ax across the entire field of view maximizes 
the correlation, (b) The advected motion is a function of y; 
the image is then decomposed in bins centered at y q , each of 
which is shifted by Ax(y q ) to obtain maximum correlation. 

position y transverse to the flow, see Fig. [T2T bV The 
image is then decomposed into strips, which are shifted 
and correlated separately, yielding an advection profile 
Ax(y q ) discretized at the centers y q of the strips. 

For 3D images, the basic manifestation of nonuniform 
flow is simple shear, Fig.fT3TaK where the average motion 
is a function of z only. The sheared volume is then de- 
composed in xy slices at different z and the correlation 
procedure is performed on each 2D slice separately. A 
more complex flow is shown in Fig. 113T b) . where shear 
occurs both in the y and z direction, as for instance in 3D 
channel flows. Here the 3D images are first decomposed 
in xy slices at different z and then each slice is further 
decomposed in y-bins for which the motion is analyzed. 

In the most general form Ar is both position and 
time dependent, Ar = Ar(r,ij), and includes shifts in 
all three directions Ax(r, ti), Ay(r, ti), Az(r, ti). For ex- 
ample, in experiments where a point-like force source is 
applied in the medium, e.g. by dragging a magnetic or 
tracer bead through a colloidal suspension , the direc- 
tion and the magnitude of the 'advected' motion depend 
on x, y and z. In such a case the imaged area (volume) 
must be decomposed into squares (cubes) , and a full PIV 
analysis must be carried out to characterize the motion 
Ar(xp, y q , z r , ti) in each element p, q, r. Another example 
is sedimentation, where Ax = 0, Ay = but Az depends 
on z. Extensions to our algorithm dealing with such cases 
are possible but we have not implemented this. For our 
experiments (simple shear or channel flow) it suffices to 
consider shifts in one direction, which are independent of 
the coordinate in that direction. 

Once the advected motion is measured, the discrete 
displacement profile Ar(x p , y q , z r , U) is then interpolated 
to give the continuous profile Ar(x, y, z, ti). This is more 
appropriate to subtract from the particle coordinates, 
which are themselves continuously distributed. Using 
the continuous profile, the transformation of the position 
*k(ti) = [ x k,Vk,Zk]{U) of particle k in the laboratory 
frame to its position fk(ti) in the CM frame of reference 
is: 

i 

f k (ti) =T k {U) -^Ar(r k (ti),^), (7) 

3=1 

where Ar(rfc (ij), tj) is the past motion between frame j 
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FIG. 13: Examples of 3D image correlation procedures, (a) 
The motion is a function of z only. The 3D image is de- 
composed in slices centered at z r , each of which is shifted 
by Ax(zr) to obtain maximum correlation, (b) The advected 
motion is a function of y and z. Decomposition into y and z 
bins yields the advection profile Ax(y q ,z r ). 



and j — 1, at the current location rfc(tj) of the particle. 
This reduces to Ar(r,tj) = Ax(y, z, tj) for our experi- 
ments. 

In the CM frame, the average particle motion (nearly) 
vanishes. The use of the classic CG algorithm at this 
point therefore allows particle tracking limited only by 
the MSFD in the CM frame. Occasionally, the CM tracks 
show some residual motion, in which case a modest im- 
provement may be obtained by using Iterated Tracking 
(Sec. EE). 

Once tracking is completed, the advected motion Ar 
is added back by inverting Eq. [7l This then provides the 
trajectories of the particles in the laboratory frame of 
reference. 



2. Limitations of Correlated Image Tracking 

A possible limitation to correlated image tracking is a 
failure of the PIV-type correlation method. This could 
arise when the frame to frame shifts are a significant 
fraction of the actual image or image-bin size. However, 
this method can work successfully for quite large shifts 
amounting to nearly the image size. To show this, we 
analyzed an experimental image series taken from plug 
flow. In this image series, the motion was slow enough 
that classic CG tracking worked; we use the results of 
this tracking as the "true" motion. Furthermore, there 
was little relative particle motion (nearly zero MSFD). 
We then took pairs of images from this image series, sep- 
arated by n frames, to model an effectively much faster 
flow rate. From the tracking, we know the shift Ax tra 
that should best align these two images. For each pair of 
images, we calculate the shift Ax^ 1 * ' from image corre- 
lation, and compare that apparent shift to the true shift 
Ax tra , in Fig. [14] (red symbols). The correlation coeffi- 
cient (thin blue line) decays roughly linearly with Ax tra , 
in line with the reduction of the correlated portion of 
the images, and plateaus at a value ~ 0.2, correspond- 
ing to the coefficient for two entirely different images of 
the same system. The latter value is specific to our high 
density system, and may vary for different systems. 

When comparing the image at time j and the shifted 
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FIG. 14: Test of the shift-correlation procedure on images of 
plug-flow. The shift in the flow direction Ax shlft (■), ob- 
tained from the correlation method, is plotted against the ex- 
act accumulated displacement obtained from tracking Ax tra 
(-), see the text. Image size: 331 x 580 pixels. Right axis: 
correlation coefficient (blue line) versus Ax tra . 



image at time j + 1 , it is important to note that in each 
case the full image is compared. Thus the shifted image 
at j + 1 has some pixels wrapped around from one edge of 
the image to the other, which has no physical meaning. 
An alternate idea would be to crop the two images, so 
that any pixels shifted outside the boundary are removed. 
Thus, when considering very large shift factors approach- 
ing the width of the image, only two narrow strips of the 
two images would be compared to determine the corre- 
lation coefficient. We find that this method is generally 
less successful, despite its intuitive appeal. When the re- 
quired shifts are large, generally using the full image is 
more likely to find the correct shift value. Comparing 
the large regions of the two images that could be po- 
tentially cropped, these will be uncorrelatcd, and thus 
in general the correlation coefficient is dominated by the 
small regions that correctly overlap. This then results 
in the results of Fig. [TJ] where the correct shift value is 
found even for Ax tra almost as much as the full width of 
the image. 

A stronger limitation to the correlation procedure is 
an excessive amount of relative particle motion between 
frames. This obviously limits the correlation compared 
to that of plug flow described above, but, more directly, 
large relative displacements cause failure of classic CG 
tracking in the CM frame, as discussed in Sec. IV A 31 
In practice we found that a maximum MSFD in the co- 
moving frame (the non-affine motion) of ~ (0.3A) 2 is the 
limiting value for the method to work. 

Non-affine motion during flow has an additional effect 
which may limit the tracking performance when subtract- 
ing shear advection accumulated over many frames. Sup- 
pose two particles start off as nearest neighbors, at a 
distance > 2R, but at 'streamlines' with different veloci- 
ties. After one frame, when the advected motion is sub- 
tracted, they remain at that distance if their motion was 



5i « i i i i i i i i i i « « « i i i i i 

. <t>=62% — •— lab.frame 
: rate=0.01 s" 1 i — -—'CM' frame, Ay=1 - 
4 7 If — ^'CM' frame, Ay=2~ 

Lmm^K^j i I i i i i I i i i i 

12 3 4 
r [urn] 

FIG. 15: Short distance behavior of the pair correlation func- 
tion g(r) from 3D coordinates of a sheared colloidal glass 
(4> = 0.62, R — 850 nm), in the laboratory frame (•), in 
the locally co-moving ('CM') frame after subtracting advected 
motion corresponding to an accumulated strain of A7 = 100% 
(■), and A7 = 200% (a). The local shear rate is7 = 0.01s _1 , 
strain accumulation during acquisition of a single 3D stack is 
~ 1.5%, while between frames it is 4%. The data show that 
particles may come in close proximity after removal of large 
advected motion. 



fully affinc. In contrast, with non-affine motion, their 
separation after advection removal may become < 2R, 
that is, they would apparently be in contact. Over sin- 
gle frames this effect is limited, i.e. particle separations 
still considerably exceed their non-affine displacements 
between frames and tracking is not affected. However, 
after multiple frames, the non-affine displacements can 
accumulate and the particle separation in the CM frame 
may have been reduced to a value comparable to the 
non-affine frame to frame displacements. This gives rise 
to tracking errors based on the same arguments as in 
Sec. IV A~3l The artificial reduction in particle separation 
in the CM frame is visible in the pair correlation function 
g{r), Fig.[T5j where we see that some particles apparently 
overlap after the removal of large advective motion. 

This problem is remedied by piecewise tracking of par- 
ticles in intervals over which the accumulated relative 
motion is small. Each interval the particles are assigned 
their identification tag, and the full trajectory is ob- 
tained by matching the tags in a one-frame overlap of 
the intervals. For the case in Fig. Qj3 particle separa- 
tions in the co-moving frame are > R for accumulated 
strains A7 < 100%, so that tracking is only affected for 
A7 > 100%, but in general a different limit may apply 
since non-affine motion does not necessarily scale with 
accumulated strain [fj^ | and may depend on <fi. 

Summarizing, the main advantage of correlated im- 
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age tracking is that particles are tracked in a locally 
co-moving frame of reference where limitations to track- 
ing are the same as in a quiescent system, as described 
in Sec. IV A 31 In other words, our method permits the 
tracking of particles in flowing colloids to the same level 
of accuracy as that in non-flowing systems. 



VI. APPLICATIONS 

In this section, we give example results from particle 
tracking in the two flow geometries already introduced 
in Sec. IIII1 viz., simple shear and capillary flow. We 
also describe the application of the confocal rheoscope to 
perform simultaneous rheology and velocity profiling of 
soft materials. 



A. 2D tracking of channel flows 

We start with a 2D example, the characterization of 
pressure-driven channel flow of colloidal pastes. We used 
a (j> w 0.63 suspension of fluorescent PMMA spheres (ra- 
dius R = 1.3 ± 0.1 fim, from microscopy), suspended in 
a mixture of CHB and mixed decalin for refractive index 
and buoyancy matching. A pressure difference, AP, was 
applied to drive the suspension into the square channels 
(side a — 50 /im, smooth inner walls). The flow across 
the full channel width was imaged in 2D at 107 frames 
per second (image size 44 x 58/im 2 , 256 x 320 pixels) at a 
depth of 17 /im from the lower surface. The images were 
collected at a distance corresponding to ~ 2000 parti- 
cle diameters from the channel inlet where entry effects 
have died out and the flow has negligible x-dependence 
on a scale compared to image size. The particles are 
located in 2D with accuracy ~ 50 nm [2(| ■ Accord- 
ing to Eq. [3J distortion of the particle image becomes 
significant only for V > VJ^f x ~ 600 (im/s, which ex- 
ceeds the maximum velocities at which we are able to 
track the particle. Assuming uniform motion, the results 
in Sec. IV B"2l suggest that iterated tracking fails for flow 
velocities V > V max ~ R x / scan ~ 140 jum/s, but in 
practice the limit is smaller due to the presence of large 
velocity gradients. 

For the experiments considered here, the flow profiles 
consist of a central region of uniform velocity V ~ V c 
and lateral zones adjacent to the channel walls where 
the shear is localized, Fig. [TBI We have discussed the 
detailed physics elsewhere [15| . To comment briefly, we 
note that such a profile in itself, could be consistent with 
predictions from the rheology of yield stress fluids [90| . 
However, in contrast to yield stress fluid predictions, the 
velocity profiles scale with flow rate and the width of the 
shear zones is independent of flow rate [l5| . By examin- 
ing the microscopic dynamics of the particles we observe 
that they are dominated by interparticle collisions and 
contacts with similarities to dense granular flows. The 
similarities extend to the shape and scaling of the velocity 




FIG. 16: Velocity profile (»,left axis) and histogram of particle 
positions ( ,riglit axis) as a function of the transverse coor- 
dinate y normalized by effective channel size a e g = a — R. 
The experiment refers to the flow of a 63.5% suspension in 
a a — 50^im wide smooth, square channel. The particles are 
arranged in well defined layers close to the walls and the shear 
decays towards the channel center where the suspension flows 
as a plug. The vertical lines highlight the j/-bins and the 
numbers match those in Fig. [17] 




FIG. 17: Illustration of the non-uniform shifts during 2D 
channel flows. The resulting displacements Axi are sub- 
tracted from the particle coordinates. Image size: 34 ^im 
x 50 fxm. 



profiles, which allowed to interpret the data using a stress 
fluctuation model initially conceived for dry grains [l5| ■ 
In these experiments, the advected motion Ax(y) is 
analyzed using correlated image tracking with a scheme 
similar to that in Fig. [T^bb We divide the image in 
horizontal bins with sufficiently uniform displacements 
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FIG. 18: Example of particle tracks in the laboratory (left) 
and in the co-moving frame (right). Circles indicate the start 
of the trajectory. The particle was situated in a shear zone 
(local shear rate 5 s" 1 ) of a suspension flowing into a square 
channel with smooth inner walls. The length of the track is 
~ 2.3 s. 




dx [pixels] dy [pixels] 

FIG. 19: Comparison of displacement distributions along x 
(a),(c) and y (b),(d) for 2D channels flows. Classic CG 
tracking in the laboratory frame (•), Iterated CG tracking 
(□), Correlated Image Tracking (■). (a),(b): slow flow 
(V c = —1.5 pixel/frame); classic CG tracking is sufficient. 
(c),(d): fast flow (V c = —12 pixel/frame). Here the classic 
CG tracking is inapplicable in the lab frame of reference (•), 
but correlated image tracking utilizing CG tracking in the 
co-moving frame of reference is successful. 

and obtain Ax(y q ) from correlation in each of these. For 
channels with smooth walls, the particles near the wall 
are arranged in well defined layers. Fig. [16] Combined 
with the fact that velocity gradients are largest near the 
edge, this motivates the choice of one-particle-wide bins 
near the walls and a larger bin in the center. An example 
of the displacement profile Ax(y q ,ti) is shown in Fig. [17] 
and, combined with Eq.[?l can be used to track the parti- 
cles in the CM frame. Fig IT51 shows a particle trajectory 
inside a shear zone both in the laboratory (left) and in 
the CM frame (right). 

In Figs. HW a).(b) we first show the displacement dis- 
tribution functions for a small velocity V c ~ 28 pm/s 
(1.5 pixel/frame), for which particles can be tracked di- 
rectly using classic CG tracking. These vanish smoothly 
within the tracking range and are consistent with the 
results (in the co-moving frame) from iterated tracking 
(open squares) and with the results from tracking in the 
CM frame, i.e. after removing non-uniform motion (filled 
squares). 

For faster flow, V c ~ 223 fxm/s (~ 12 pixels/frame), 



correlated image tracking is required. In Figs. I19f c) we 
show P{dx) from classic CG tracking (filled circles). The 
strong asymmetry and sharp cutoff show the inapplicabil- 
ity of this method. Results from iterative tracking, i.e. af- 
ter removing uniform motion obtained from a preceding 
direct tracking step, (open squares) still reveal asymme- 
try and are not reliable. Instead, the results from cor- 
related image tracking (full squares) are symmetric and 
show virtually no cut-off effects. The y-dependent mo- 
tion after restoring these tracks to the laboratory frame 
are consistent with the advection profile Ax(y) from cor- 
relation, confirming the success of the method. We note 
that for the different methods, the distributions P(dy), 
shown in Figs. [TWd). do not show any difference despite 
the variations observed in P(dx). This again illustrates 
that care must taken in interpreting displacement distri- 
bution functions from particle tracking as described in 
Sec. ELS 

Finally, we also tested the method on ~ 30% volume 
fraction suspensions in quasi-2D channels yielding the ex- 
pected parabolic flow profiles [76|, [9l[ . With correlated 
image tracking we have been able to successfully track 
particles in flows with velocity as high as 250/im/s cor- 
responding to almost twice the limit V max mentioned 
above. 



B. 3D particle tracking in simple shear flow 

Next, we move to full 3D imaging and consider a col- 
loidal glass in steady shear flow, measured in the rheome- 
tcr or the shear cell with rough, coated surfaces. The 
apparatus has already been described in Sec. IIII1 The 
colloids (radius R = 850 nm) are suspended in a charge 
screened CHB-decalin mixture for refractive index and 
density matching (rj = 2.6 mPa-s). The volume fraction, 
measured from the average Voronoi volume determined 
from particle coordinates, is <fr = 0.62. Each 3D image 
consists of 76 slices (256 x 256 pixels each, 2D frame rate 
/ = 45 s _1 ), imaged over a height z max — zq = 15 /im 
with zq either 10 fim or 15 (im (z = at the cover 
slide) and was acquired in ~ 1.7 s. The voxel size is 
0.11 x 0.11 x 0.20 /im 3 . The local shear rate j which we 
measure (see below) may exceed the overall applied rate 
7 a . This is due to global shear localization, which we 
observed directly in velocity profiles v(z) measured from 
image series on a coarser z-scale, which we will describe 
in detail elsewhere (92l |. 

The intrinsic accuracy for locating particles (with the 
refinement in [79|). obtained from the MSD in a ran- 
dom close packed system (no flow) is ±30 nm in x,y and 
±70 nm in the z-direction. Under flow, using Eq. [3] in 
Sec. IIVB1 the velocity for which distortion of the particle 
image sets in is V^jf x ~ 1 /zm/s, exceeding our largest 
measured velocities V max ~ jz max . The error due to 
short time thermal displacement is ±30 nm, not exceed- 
ing those mentioned above. 

In Fig. [20] we show results for slow shear, where classic 



16 



- 1 1 1 1 1 1 — 

F (a) 


—i r 


— 1 1 1 1 — 


, , , , 
dt=4s : 


: 4 

f o 

•. a . . 


dx 
dx 


(non-affine)' 


n 
n 



dx, dx, dy [^m] 

i 1 1 1 1 1 1 1 1 1 1 1 r r 




1 10 100 

t[s] 

FIG. 20: Direct tracking of a sheared glass at 7 = 9.3 x 
1(T 4 s _1 (a) Histo grams of frame to frame displacements, 
(b) Displacements dx versus z for all particles over 10 frames 
(dt = 40 s). The line is a linear fit, the slope of which gives 
the local shear rate 7 = 9.3 x 10 -4 s _1 . (c) Mean squared 
displacement (dy 2 {t)) in the vorticity direction, (dz 2 (t)) in 
the gradient direction, and the non-affine MSD (dx 2 (t)} in 
the velocity direction. Line: (dy 2 (t)) — 2D y t with D y — 
3.6 x 10 -4 fim 2 /s. 

CG tracking is sufficient. Figure l2"0Ta) shows the dis- 
tribution of frame to frame displacements along x (the 
velocity direction) and y (the vorticity direction). The 
former is shifted and slightly broader compared to P{dy) 
due to the z-dependence of dx and the zero- velocity plane 
being outside the image, which is illustrated by the dis- 
placement profile (dx(z)) in Fig [20Tb1. The profile is 
linear on average on this z-scale, the slope gives the lo- 
cal shear rate 7 = 9.3 x 1CP 4 s -1 , and it extrapolates to 
zero within experimental uncertainties at the cover-slide 
(z = 0), confirming that the coating provides a stick 
boundary condition. 

Locally, the shear induces plastic breaking of the par- 
ticle cages, causing diffusive behavior at longtimes, as 
shown by the MSDs in Fig H|c) (see also [§1]). This 
diffusion contrasts a quiescent colloidal glass where the 
long time particle dynamics remains caged. Figure [2"0T c) 
includes the MSDs in the three directions x, y and z, 
where for the x direction we use {dx 2 (t)), with 

dx(t) = x{t) - x(0) - 7 / z(t')dt', (8) 
Jo 

which represents only the non-affine displacement. Note 
that with this definition, the usual effect of Taylor disper- 




dx, dy [fim] 

FIG. 21: Histograms of frame to frame displacements, in a 
comoving frame with {dx) = 0, obtained from iterated CG 
tracking (Pit, squares) and from correlated image tracking 
(Pcit, circles) for 2D imaging in the velocity vorticity plane 
of a sheared glass (V = 1.6 ^im/frame, 7 = 0.019 s" 1 ). Inset: 
the MSD (dy 2 (t)) (■), and {dx 2 {t)) in the co-moving frame 
(□), from tracking in the CM frame. Line: (dy 2 (t)) = 2Dt 
with D = 5.4 x 10" 3 ^m 2 /s. 



sion is suppressed, see e.g. [§3|]. As observed, the MSDs 
are nearly isotropic, i.e. the (non-affine) structural relax- 
ation due to cage breaking is nearly the same for all di- 
rections [69[ . The distribution of the non-affine displace- 
ments dx is also included in Fig. [20Ta). and coincides 
with P(dy). 

We now turn to faster shear, 7 = 0.019 s . We first 
consider a 2D image series taken at z = 18 /im from the 
3D stacks. From correlation we find a uniform motion 
with a constant velocity V — 1.6 /im/frame. To com- 
pare with Sec. IV B 21 using A ~ 1.8 (im as the particle 
spacing, this corresponds to a reduced shift s/A ~ 1 
between frames. We locate the particles in 2D, and 
track them both with iterated CG tracking, and with 
correlated image tracking, using Eq. [71 In Fig. the 
frame to frame displacement distributions from iterated 
tracking are shown, with P(dx) evaluated in a co-moving 
frame so that (dx) = 0. Thse distributions are cut-off at 
dr = Rt = 1 /im by definition; the tracking program 
does not consider possible displacements larger than Rt 
(frame-to-frame). Pixidx) is asymmetric, similar to the 
MC data in Fig.[H|b). 

This changes when we use correlated image tracking 
and then examine the measured displacements in the co- 
moving frame. Now, the displacement distribution func- 
tions, Fig. [5U are no longer cut-off and coincide for dy 
and dx (in the co-moving frame) , indicating correct track- 
ing. The inset shows the resulting MSDs (dy 2 (t)) and 
(dx 2 (t)) (the latter again in the co-moving frame). As 
for slow shear, the dynamics is nearly isotropic. A more 
detailed description on the shear-induced structural re- 
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FIG. 22: 3D analysis of a sheared glass at 7 = 0.019 s _1 . (a) 
(•) accumulated displacement Ax a (z r ,t,dt) from image cor- 
relation, for t — 40 s over dt — 16 s (4 frames). Connecting 
lines represent the interpolating profile, defining Ax(z,t,dt). 
Line: linear fit giving an accumulated strain dAx a /dz = 0.28. 
(b) Distribution of frame to frame displacements P(dx) and 
P(dy) after tracking in the CM frame (Rt = 1-1 fim) and 
restoring the coordinates in the laboratory frame. Also shown 
is P(dx) of the non-afhne ^-displacements, using Eq. [8] and 
7 = 0.019 s -1 . (c) the (non-affine) MSD in the three direc- 
tions. The data are consistent with those in Fig. 1211 inset. 
Line: (dy 2 (t)} = 2Dt with D = 5.4 x 10~ :i ;im 2 /s. 

laxation is given in [§9j . From the frame to frame MSD 
(dy 2 (t = 4 s)} ~ 0.05 (im 2 we obtain (dr 2 )/A 2 = e 2 ~ 
0.03, within the limits for tracking in a concentrated qui- 
escent system, Fig. [5] 

To analyze the 3D data, we use correlated image 
tracking where the correlation procedure is performed 
on image sequences at different heights z r = 10 + 
2r /im (r integer), as shown in Fig. I13f a). From 
this, we obtain the accumulated displacements profile 
Ax a (z r , t, dt) — Y^t-dt Ax(z r , t), an example of which is 
shown in Fig. l2"27 a) for t = 40 s and dt = 16 s. The pro- 
file is linear and again shows approximately stick bound- 
ary conditions. Time averages (Ax a (z r , t, dt = 16 s))t 
(not shown) virtually overlap these data, showing that 
the flow is steady. To subtract this advected motion 
from the particle coordinates, we use the linear interpola- 
tion profile Ax(z, t, dt) shown by the lines connecting the 



symbols. Since both accumulated strain and non-affine 
displacements are large in this case, we performed both 
the subtraction of Ax(z, t) (see Eq. [7]) and the "piece- 
wise tracking", in intervals of 10 frames (A7 = 80%), 
as described in Sec. IV C 21 The resulting displacement 
distribution functions are shown in Fig. I22f b). both for 
the non-affine and the real displacements. Note the large 
range, /im < dx < 3 /im, of the latter, resulting from 
the strong z gradient in advected motion. Finally, we 
show the MSDs for x, y and z calculated from these 3D 
data. The results for dx 2 and dy 2 match those in the 
inset to Fig. [5U while dz 2 shows that despite the large 
shear rate, the dynamics remain nearly isotropic. 



C. Rheology and velocity profiling 

As a last example we describe the results of experi- 
ments on a more dilute colloidal suspension using the 
confocal rheoscope in cone-plate geometry. Here we mea- 
sure simultaneously the rhcological response and map the 
velocity profile during flow, Figs. 16171 

The sample consists of a <j> ~ 55% suspension of non- 
fluorescent PMMA-PHS colloids (radius = 150 nm) in an 
index matching (decalin-tetralin) mixture, seeded with 
~ 0.5% fluorescent tracers (radius = 652 nm). Both the 
cone and the cover slide are coated with a layer of tracer 
particles. From the image series of the cone motion, we 
can verify the rotation speed of the rheometer during op- 
eration and by focusing on the top and bottom coatings 
we can map the spatial profile of the cone-plate geom- 
etry In Fig. [53] we show the variation of the gap size 
as function of the distance r from the center of the cone 
measured using the lateral objective translation. The 
truncation gap is nicely resolved and the data show that 
bending of the cover slide is negligible. 

The velocity measurements were performed in two 
ways. One is the 'time-resolved' mode: similarly to what 
is described in Sec. IVIB1 we rapidly scan 3D stacks of 
~ 20 to 50 slices, covering the entire gap from z = to 
z = Or with 9 the cone angle, Fig. [7{a). We use an oil- 
immersion objective with 200 fim working distance (60 x 
magnification) and scan at equal speed both up and down 
to avoid disturbance of the sample due to large sudden 
displacements of the objective. By extracting the image 
series at each height and using the correlation method 
fSec. IV C"Tj) . we obtain the time resolved displacements 
and shear profile. Typically it takes At ~ 1 s to scan the 
gap. For the particular case of images containing trac- 
ers, displacements up to approximately half the image 
size S can be measured. Therefore, this mode is suc- 
cessful for maximum velocities v ~ S/(2At) ~ 50 fim/s, 
with S = 100 /im, which translates to 7 a r < 5/(20 At). 
In the second mode ('stepping') we simply record a 
time series at each z and reconstruct the velocity pro- 
file v(z). Here the maximum velocity which can be mea- 
sured is considerably larger: v ~ 5'/ scan /2 ~ 5 mm/s for 
/scan = 100 s _1 . This corresponds to a maximum shear 
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FIG. 23: Gap profile of the cone-plate geometry, measured 
by confocal microscopy with fluorescent coating on both the 
bottom (glass) surface and the surface of the cone (radius 
20 mm). The truncation gap is clearly visible and the profile 
extrapolates at zero height in the centre. The nominal values 
of the truncation gap and of the cone angle are in brackets in 
the figure legend. 



100 



z/z 

gap 

0.0 0.2 0.4 0.6 0.8 1.0 



10 



CD 
Q_ 





-1.0 
-0.8 

-0.6 ;>" 

-0.4 > 
-0.2 _ 
-0.0^^^ 




• 
■ 

▲ 



0.01 0.1 



10 



objectives. 

Figure [24] (main panel) shows the steady state flow 
curve of the sample. Since the suspension at this vol- 
ume fraction is in the proximity of the glass transition 
(4> g ~ 57%), the expected low-rate Newtonian regime 
occurs at shear rates below our experimental window. In 
the regime we measured, 0.006 s _1 < 7 < 30 s _1 the sam- 
ple exhibits strongly nonlinear rheology with pronounced 
shear thinning response (the viscosity decreases dramat- 
ically on increasing shear rate). In the inset we show 
some velocity profiles, measured in the 'stepping' mode 
at different shear rates and various distances r from the 
center of the cone. The corresponding gap sizes range 
from Zgap — 50 fira at r = 2.5 mm to Z gav ~ 100 ^m 
at r = 5 mm. It is clear that the normalized profiles 
are linear, independent of 7 and r. In the case of larger 
volume fractions, above the glass transition, <f> > <p g , we 
observe either slip or shear localization, depending on the 
boundary conditions. These results will be discussed in 
detail elsewhere [7a, \9M . 
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VII. CONCLUSION 

In this paper we have described new instrumentation 
and analysis algorithms for 2D and 3D imaging studies 
of concentrated (colloidal) suspensions during flow. The 
combination of fast confocal microscopy and controlled 
flow, such as in a rheometer where simultaneous rheolog- 
ical information is available, opens up new horizons for 
the study of driven soft matter systems at high concen- 
trations. Our evaluation of the CG tracking algorithm 
establishes the validity of previous experiments on col- 
loidal dynamics. Finally, our method for particle track- 
ing in a locally co-moving frame allows us to investigate 
the affine and non-affine dynamics of colloids during flow 
up to relatively large velocity (gradients), limited primar- 
ily by the amount of non-affine motion during flow. The 
method could therefore be of use in a variety of other ap- 
plications, including the study of granular flow at single- 
particle level. 



FIG. 24: Main panel: steady state stress a versus applied 
shear rate 7 for a (f> ~ 55% suspension of hard-sphere colloids 
of radius 150 nm. Inset: velocity profiles, normalized by the 
velocity of the cone V CO ne, as a function of the height, normal- 
ized by the local gap size Z gap = Or of the geometry. Data 
for 7 = 10 s _1 are taken at different positions r — 2.5 mm 
(•), r — 4 mm (■) and r — 5 mm (a) and for 7 = 0.5 s _1 
data are taken at r = 5 mm (□). 

rate of 7 ~ 30 s _1 for r — 10 mm. Note that even larger 
velocities can be measured by using smaller magnification 
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